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ABSTRACT 

Plant parameter variations due to environmental changes present a 
problem in any control system design. In this paper, two adaptive control 
techniques which compensate for large or small parameter variations are 
proposed. The variations in the parameters are identified by using the 
error between the plant output and a fixed model output together with 
the plant sensitivity functions which are used to identify plant para- 
meter variations. One adaptive technique uses the identified parameter 
value to physically change™ene plant™parameter and the other adaptive 
technique uses the identified parameter value to generate a compensat- 
ing input to the plant. A mathematical model for the simultaneous 
generation of the desired output and the sensitivity functions is 


described. Several examples using both techniques are considered. 
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| Introduction. 

An adaptive control system must provide continuous information about 
the present state of the plant. It must identify any variations in the 
plant parameters or the plant dynamics; compare present system performance 
to the desired system performance; and modify the system to achieve over- 
all optimum performance. 

In the model-referenced, or model-following, adaptive control system 
of figure (1), the desired system performance is dictated by the plant 
model. When a parameter in the plant changes the output of the plant, 
Ne will differ from the output of the model, x ft); thereby generat- 
ing an error signal, e(t). Once an error signal has been generated the 
adaptive system must identify which parameter, or parameters, of the plant 
have changed and how much they have changed. The adaptive controller must 
then use the information arrived at by the identification process to 
modify the plant. 

The majority of the adaptive control systems presented in the litera- 
ture consist of two major functional black boxes. [1], [2], [3], [4], [5]. 
One black box is called the identifier and the other is called the adap- 
tive controller. The function of the identifier is to compute a perform- 
ance measure, which is a functional relationship involving system charac- 
teristics in such a manner that operating conditions can be determined. 
The performance measure defines the optimum performance of the system. 
Identification is usually accomplished by deciding how the actual system 
performance relates to the desired system performance. 

The adaptive controller is then used to calculate and implement 
either control signals, or controllable plant parameter changes to either 
maximize or minimize a performance measure. The optimum is generally ap- 
proached gradually by a succession of decision, identification, and modi- 


fication steps. 
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Model-Referenced Adaptive Control 


| PLANT 
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| MODEL *m (t) 


c(t) e(t) 









Adaptive 
Controller 


r(t) - - input reference signal 


e(t) = 2S - x fb) 


Fig. (1) 
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Bingulac, [6], uses sensitivity coefficients to measure the capability 
of the adjustable controiler parameters to compensate for the variations 
of plant parameters. In this way it is possible to facilitate quick 
selection of the best possible controller parameters to be adjusted by the 
adaptive system. Dorf and Burzio, [7], use the sensitivity coefficients 
to directly control the variation of certain parameters of the plant so 
as to minimize the error signal in a model-referenced adaptive control 
system. In this paper the sensitivity functions are used to identify the 
amount of a parameter change. Thus, they form the basis of the idenfi- 
fication process. 

Two different adaptive techniques as discussed by Eveleigh, [5], are 
investigated in this paper. Technique number one is to identify what 
parameters have changed, determine how much they have changed, and then 
to re-adjust the plant parameters to new values as determined by the 
identification process. This assumes that the plant parameters are avail- 
able for adjustment. Adjustment of the variable parameters of a plant by 
means of a characteristic equation which exhibits singular lines on the 
parameter plane is also described in this paper. Technique number two is 
to use the identified parameter changes to generate an optimum control, 
u*(t), which when applied to the pliant, minimizes the error signal between 
the plant and the model. 

This thesis discusses the implementation of these methods using a 
sensitivity model to identify the plant parameter changes. The use of a 
sensitivity model in an adaptive control system to perform the identifi- 
cation of parameter changes is a new concept and is proposed in this 
paper. Several examples involving digital computer simulation are in- 


cluded, the results illustrating the general effectiveness of the technique. 


1S. 


2. Parameter Identification. 

In order for any adaptive technique to be successful, that is, for 
the plant output to follow the model output, and for the adaptive system 
to be practically realizable, the plant parameters must be accurately 
identified with easily obtained signals. The identification process of 
an adaptive control system is the most important and most critical pro- 
cess that the system performs. 

The states of the plant, oe are a function of time and the variable 


parameters of the plant, Ke 


Let Q., be the nominal or model value of the i-th parameter. The states 
of the plant can be expanded in a Taylor series about the nominal para- 


meter value of the i-th parameter to get; 


2 
= Xo (t O4 X p(t, Xe) 2 
(1) Xo(t Xz) = X elt A.) + dealt ei) (o; —X;,) a + d¥elt,xe) (x: -%,,\+ seas 


4 ) 
Cre . _ 
£ =e Me = kag 


The Taylor series expansion of equation (1) gives an exact relationship 
for the states of a plant when its parameters vary about their nominal 
value. 

The sensitivity of the states of the plant with ornare to the i-th 


variable parameter is defined as; 


(2) Vilt)2 OXe( to) 
; dhe a; 


i ad \ 
SSE RS NS 


which can be written as, 


(3) 
vift) 2 a,, O%elF,%o) 


' Kio 
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If the parameter changes are small enough so that 


TORO ~O 
‘a 


then equation (1) becomes 


(4) x (t,o: ) = Xp (t Xi) a Vit) Ak, ~Xio) 


P Kio 


In equation ee aCe: Q-, ) is the state vector of the plant with 
nominal parameter values. The state vector of the plant model, x ft, Ko ),; 
is the state vector of the same plant with invarient parameters set at 
the nominal values. Therefore, oes Keg ) = x (ts Keg ), and equation 


(4) becomes, 


(5a) (tv = ve(t) AX 
Kio 
where 
(5b) Elt) = X plt,ar) — X(t, %,) 


Equation (5b) when written in matrix form becomes 





oe (t) - Xa (t) 
“sy. (t) - x2 (t) 
n (t) an Co) ee (t) 


where 1, 2,....,n refer to the states of the plant. Thus, it is obvious 


that equation (5a) can be written in scaler form as, 
(6) 
e(e) = vi, (t) ASME 


Lo 
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where e(t) is the error between the output state of the plant and the out- 
put state of the model, and v, (t) is the sensitivity of the output of the 
plant with respect to the i-th variable parameter. 

If there are N independent variable parameters in the plant, a Taylor 
series expansion is made for each parameter similar to equation (1) and 


the N expansions are added by the laws of superposition to get, 


N 
7 : 
a eey= 2 v(t) Ax 


i= to 

Equation (6) tells us that the error between the output of the plant 
and the output of the model which is caused by a parameter variation is 
directly proportional to the sensitivity of the output of the plant. 
This statement on first glance appears to be very simple, and is indeed 
logical since the sensitivity functions give an indication of how the out- 
put of the plant will vary when a parameter is changed. However, equa- 
tion (6) implies a few subtle points which are best illustrated by the 
following example. 

Assume that the plant under consideration is first order and that 
it is driven by a unit impulse function. The response or output of the 
plant is given by; 
(8) dx + a(t) x(t) = O(t) 

dt 

where oo (t) is the variable parameter of the plant and &(t) is the 


impulsive input. The solution to equation (8) can be written as; 


. 
(9) -~fawrdt 
x(EV 2 E 


If a step change in the parameter occurs at time t = T, then the time 


variation of the parameter is written as; 
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(10) a(th)= Kod Wt) + A(T) U(t-T) 


Integrating both sides of equation (10) for the time interval o<¢t€¢t 


yields; 
T 
ay jae dt = XCovt Ut) + AK(T)(L-T) U(4-T) 
.¢) 


From equation (11), the solution to equation (8) becomes; 


(12) 
SOC ACh) eed) ece a) 
C2) a a 
If the change in the parameter at time T is small enough to allow the 


exponential to be approximate by the first two terms of its Taylor series 


expansion, then; 


== 


Xt 
va YU\=2e (I-G-T) Anat] 


Now, if the desired response, or the parameter invarient response, is 
given by 
~Xot 
yn | eae aos 


then the partial derivative of x Cb) with respect to the nominal para- 


meter value is given by; 


(14) , Gee a 


OX, 


which when time shifted to t = T becomes; 


~X5(t-T) 
X%e(t—-T) = — Gara me ul es 


O %o 


Equation (13) then becomes, 


(15) 


Swe one 
K(x) =e —(t-T) Ax(Tye ° 


-X_ 0 OX (t-T) Aa (T) 


= X,(t,%,) + © 
d %o 


(16) X(t) = XN Grove) + 0G cate) Ax(T) 
Ko 


In a model-referenced adaptive control system, the error signal is given 


by, 
C (+) = X(t a) ao Xo (+,%.) 


Therefore, for a parameter change occurring at time t = T equation (16) 


becomes; 


(17) C(4—-T) = Xo (T,%) OKT) a 
Ko 


which with the use of equation (2) becomes; 
© 


where v(t-T) is the sensitivity of x(t, &, ) with respect to &, 
Equation (18) shows that the error signal is dependent upon the value 

of the desired response at the time of the parameter change and upon the 
sensitivity of the desired response with respect to the nominal parameter 
value. In order to use the sensitivity functions, v,(t), in the identi- 
fication process, the following criteria must exist: 

1. The parameter changes must be approximately less than fifteen 

percent for an error less than five tenths of a percent. 
2. The sensitivity functions must be generated from the output 


of a parameter invarient model. 


ihe: 


3. The generation of the sensitivity functions must not begin 
until a parameter change occurs. 
4, If there exists more than one variable parameter in the 
plant, all parameters must be independent of each other. 
It will be computationally convenient to take the derivative of 


equation (5) with respect to time to get, 





(19) ea) zu, cy) aS + v(t) CARD 21 
Kio dt Kio 


The plant parameters are assumed to change in a piece-wise,constant, 
step-like manner. Therefore, over a small time interval At, the para- 


meter change is constant and 


d (Ax; ) = O 


dt 


Over this small time interval, e(t) and v(t) can be approximated by the 


slope of their respective curves. Thus equation (19) becomes, 


E(t +At)— e(t) — Ve(e+At)~ Ved) , AX 


which reduces to, 


2) eee gat) = ele =fvctesae —Yete) $8 


Therefore, the change in parameter OA; , for the case where N = l, be- 
comes, 


ax, - Jetrat) ~e@ og 
Tvj(t+at) ~v(t) 


(21) 


Prior to the occurrence of a4 parameter change, the identification pro- 
cess is not necessary. At the time t = T, the time the first parameter 
change occurs, e(t) = e(T) and v(t) = v(T). Therefore, the amount that 


the parameter &, changes is given by, 
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Ak, = Onn eC(T+At ) ae CCT) 


De 
=) Vi(T+At) — V,(T) 


For a plant which has only one variable parameter, the amount of the 
parameter change can be identified by sampling the error signal and the 


sensitivity signal at time t = T + Qt and applying equation (22). 


If the plant has N independent variable parameters, equation (20) 


becomes, 
(23) 
[e(erat) — eCt)] =[V (e+ ae)-Vi (4016, + [v,(t+at)-V2 (t)]C24> > 
oe oe [Vy (t+ At) — Var (td) Cw 
where ar = Ad; 


Equation (23) contains N unknowns. For a one parameter system it was 
necessary to sample the error signal and the sensitivity signal only once 
to determine the amount of the parameter change. For a system with N 
variable parameters it is necessary to solve N simultaneous equations to 
determine N parameter changes. Therefore, it is necessary to sample the 


error and sensitivity signals N times. 


fe(T+At) -e(T)] =[VWlt+at) -WIT)] CG, +2 ee 4h (T+at) “Val T)] Gn 


le(T+2At)—-e(T+ At)\=[M(T+2At)-V, (T+ Ot)]G. + +4 [Vu (THZAt) “Vy (Trae 


¢ 


(24) 


e 
o 
L 


[ e(tawat)- e(t+(W-at)] =[V (T+ Aad) -Y, (THANE y|qjreee 
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Equations (24) represent N simultaneous equations arrived at by 


sampling N times. These equations can be written in matrix form as, 


) sea eS 
where E is an Nxl vector 
V is an NxN matrix and eA ae 


C is an Nxl vector 


Now: 


(26) Ca iG 


from which the parameter changes can be determined. That is, 


(27) 
Akos Kis CC!) 
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3 Sensitivity Functions. 

The previous section showed how the sensitivity functions can be 
used in the identification of variable plant parameters. In this section 
the method of generating sensitivity functions is discussed. The sensi- 
tivity functions give an indication of how the states of a plant will 
vary when its parameters change. As a result, each sensitivity function 
can be considered as an error in the plant output caused by a parameter 
change. The total error in the plant's output is a linear sum of the 
individual errors, or sensitivity functions, as was shown in equation (7). 

The sensitivity functions were previously defined as, 


x . 
Ve (t) a Lio _O¥ (4 %20) 


(28) 
O Xi 


Consider the linear time varying system 
(29) Xo (t,o) = A(t,0) Xp(tx) + Be) W(t a) 


Taking the partial derivative of equation (29) with respect to & and 
evaluating at R= &%, yields, 


(30) O%e (4,0) _ A(t,a) ox (to) + Xp(t,a) ee + B(+) atic) 
OX | a : 3 


~ 
0 Ash, A= A, A= XK, ra) 








Substituting (28) into (30) yields, 


31 
WUE) = AL He) VCE) + Ole CUE) Xp (Eyelg) +O, 3 (4) butte 
a 





oH =sK, 
where 
C.,(@)= Acs (t, 0) 
a X= XK, 
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H. D'Angelo, [8}, proposed using the plant sensitivity functions 
and all of their derivatives in a performence measure and then minimiz- 
ing the performance measure with respect to the control, u(t). The 
optimum control which resulted was a function of the sum of the sensi- 
tivity function and its derivatives, that is 

C4 
Vi (t) an ae eve) + oree 
na u 

S. Kahne, [9], proposed using sensitivity functions in a perform- 
ance measure also. Kahne’s approach was to write a sensitivity state 
equation similar to (31), from which he generated the sensitivity func- 
tions as shown in figure (2). 

The approach taken in this paper is to use the sensitivity functions 
to identify plant parameter changes. In this way the sensitivity func- 
tions can be used as reference signais and must not vary when the plant 
parameters vary. 

In the method of generating sensitivity functions shown in figure 
(2), if a plant parameter changes, then x(t), v(t), and u(t) will change. 
Thus, the sensitivity functions will not give a good measure of how the 
plant states vary with respect to some nominal parameter, and will not 
be useful for the identification process. 

Therefore, in order for the sensitivity functions to be useful in 
the identification process of the adaptive control system, they must not 
be dependent on the states of the plant or upon the control which drives 
the plant. 

If the sensitivity functions were generated by a plant model which 
is invariant to parameter changes, then the sensitivity functions could 


be used for parameter identification. Equation (19) reduces to 


(32) V(t) = ACEH) YE) + C(t) Xm (Ko) 


Zo 


Kahne's Plant and Sensitivity Model 


Plant Sensitivity Model 


x(t) du V(t) 


ute) | x= Ax + BU 
BNET eS OX 


VrAV +CX+B 


ux(t) is the optimum control which is generated by the 


process in block F 


Fig. (2) 
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Equation (32) represents a mathematical mcdel which can be used to gener- 
ate the sensitivity functions. It should be noted that, 

Kahne and D'Angelo penalized their system for having variable para- 
meters by including the sensitivity functions in their cost functions. 
The approach taken in this paper is not to include a penalty for sensi- 


tivity, but to use sensitivity for the identification problem. 


4, Model. 

The adaptive control system must be able to identify the plant para- 
meter changes from signals which are easily generated. The purpose of 
the plant model is to generate the desired output and the sensitivity of 
the output with respect to the variable parameters. The model must 
generate the desired output and sensitivity signals simultaneously so 
that there will be a minimum time delay in correcting for the parameter 
changes. Rajko Tomovic, [10], has presented a method whereby the sensi- 
tivity functions can be generated simultaneously with the desired states. 
This method is illustrated in figure (3). 

Figure (3) shows that the response of the plant model, X(S54) 945) 
can be introduced into an identical model to obtain the sensitivity 
functions, Vy and Vo: The sensitivity functions can be generated on an 
analog or digital computer using the state variable approach. This paper 
employs the latter method for reasons which will become apparent later. 

It should be re-emphasized that the sensitivity functions should 
not be generated until a parameter change has occurred. The sensitivity 
model should be triggered when le (t)| > 0 or when t = T. Where T is 


the time at which the first parameter change occurs. 


Example (1) 

This example serves to illustrate Tomovic's method of generating 
sensitivity functions. Consider the first order system of figure (4a). 
Let y(t) =E for O¢t< te 
therefore y(s) = E/s. From figure (4a) it follows that 


ae m \ =X, 
xCs) = ore which gives x(t)= eae Se & ) 
where heatAot Ks 
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Tomovic's Plant and Sensitivity Model 


Tis) — A£ 0M 
We(s) dar 


Sensitivity Model 


| 
| > Vi (S) 
| | 


Plant Model 


W, (5,4) 


We.(S,%2) J 


O, W, (5,3) 












T2(s) i) V> (s) 


% (5,9, Fe) '. 


qj and qd, are the variable plant parameters 


Fig, (3) 


zy 


X(t, Ag ,K,) 





| St Ae 


y(t) + X(tRovKe) + | 
S+A, _ | St+Ae 





Ke 


| 3 -V, (t) 


Plant Model | Sensitivity Model 


Fig. (4b) 
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From equation (28) 


V(t) = A, —OXC+: Ro ikke 
> As 


V2(t) = Ko OX (t) Avy Ko) 


Xo 


which yields, 


V.i(t)= EA, [-= + (+ dey ee] 
v.02 Eke bag + Ga tare J 


Tomovic's method is shown in figure (4b). From figure (4b) it 


follows that; 


Lxcs)+ as gg =-\4(5) or V2(s) = Prvirig 
SASt+ AX, 


which yields 


~ Xo 
Mae) s Eke Lage CE + dye 
and 
aS s ADE 
$(Sta)* 
which yields 
a ot 
Vy, (4) = EA ae t(S ot) 


Zo 


Thus, Tomovic's method yields the same equations for the sensitivity 
functions as were found by direct differentiation. 
The following state equations can be used on a digital computer as 


the plant and sensitivity models. 
X(t)=—- (Ayr ky) X(t) + Y(t) 


Vp (t) -~ Is. X(t) 7 (A+ Ko) 2 (4) 


These state equations can be solved to determine the desired output and 
the sensitivity functions for use in the identification process. The 
proposed model for the adaptive control system is a mathematical model 


which is independent of parameter variations and can be simulated on a 


digital controller. 
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Se Illustrations of the Parameter Identification Process. 


Example (1) First order plant, one variable parameter 

This example serves to illustrate the effectiveness of the 
parameter identification process on a plant which has only one variable 
parameter. The sensitivity functions are generated by the Tomovic method 
discussed previously. The system shown in figure (5) was simulated on an 


IBM-360 digital computer using the following state equations: 
Xm(t) = — KX X(t) + MX E(t) 


— *xX,(t) + & EQ) 


Xp () 


v(t) 


At time t = T, parameter & underwent a step change by an 
amount AX thus creating a non-zero error which initiates the genera- 
tion of the sensitivity functions. The sensitivity functions and the 
error signal are sampled at time t = T+ Qt. The amount of the para- 


meter change which is determined by the identification process is given 


by 
Se ee eG 9 SD 
V Grea n) 
where OX, = nominal parameter value= 0.20 


At 


The new value of the parameter, as determined by the identification 


sampling interval = 0.10 sec. 


process, is given by; 


A(t) =x, + AX, (t) 


The percent error in the identification process is defined as; 


a | &(e)- x5 (4) | 
& (t) 
31 


6 
% Error x 100 % 


One Variable Parameter Identification 


Example, Step Parameter Change 


5 VS 
At 


Ce) 


& —_—» 
+4 dt 





Fig. (5) 


32 


where  (t) is the actual value of the plant parameter after the change 
occurs. The percent error in the identification process is a measure of 
the accuracy of the process. 

Table (I) shows the results of applying a step change of An = 
-0.01 to the parameter at T = 1.5 sec. The reference input for this ex- 


ample, E(t), is a step function of magnitude ten. 


Table (TI) 
Time identified identified % error in 
Xr (t) AX, (t) identification 

P00 0.19000 -0.01000 0.0000 

70 0.18999 -0.01001 0.005270 

1.80 O213998 -0.01002 0.010729 

aye 0.18997 -0.01003 0.016281 

2.00 0.18996 -0.01004 0.021991 


It should be noted that; 


GUNES Sete ee ee Cie 
a4 


o vine) ~ VES) 


Dee iy= x, ect 


V(h7) - V¢I-6) 


Figure (6b) shows the nature of the parameter change; (6c) shows 
the error between the output of the plant and the output of the model; 
and (6d) shows the sensitivity of the model output with respect to the 
nominal parameter. The accuracy of the identification process, as indic- 
ated by the percent error in the identification process, can be seen to 
decrease as time increases. This is primarily due to the build up of 
truncation and round-off errors in the computer simulation. The con- 
tinuous identification process is accomplished by sampling the error 
signal and the sensitivity signal every fA t seconds and performing the 
identification process at the end of each sampling interval. Thus, the 
errors are allowed to build up from sample to sample. 
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v(t) 

(d) Sensitivity of 
output with 
respect to « 

aes TE (SeC) 
enw 
Fig. (6) 


Several runs were made with a step reference input and a step 
parameter change. In each run, a different parameter change occurred. 
These parameter changes occurred at different times. The percent error 
in the identification process was seen to increase as the amount of the 
parameter change increased. The accuracy of the method employed to deter- 
mine parameter changes was seen to be very good for changes up to about 


fifteen percent. 


Example (2) 
This example is the same as example (1) with the exception of 
the reference input and the amount of the parameter change. The refer- 


ence input is given by; 


E(t) = 10.0 sin (t) 
The variable parameter was changed from & = 0.20 to O& = 0.21 at time 


T = 1.5 seconds. The results of this example are shown in table (II). 


Table (II) 
Time identified identified % error in 
As (+) Dx, (t) identification 

1.60 0.21000 0.01000 0.000000 

1.70 0.20999 0.00990 0.0047686 

1.80 0.20998 0.009979 0.0097922 

1.90 0.20997 0.009968 02015157 

2.00 0.20996 0.009956 0.021089 


Example (1) and (2) have illustrated the accuracy of the 
identification process on a plant which is of first order and has only 
one variable parameter. The identification process can easily be ac- 
complished by the adaptive control system. [It should be noted that self- 


adaptation was not attempted in either example. 


6h) 


Example (3) Second order plant, one variable parameter 

In this example a second order plant with one variable para- 
meter undergoes a ramp change in the parameter. That is, the parameter 
is a constant value until it undergoes a time varying change at time t = 
r. 

The plant which is used in this example is shown in figure (7a). 
The nominal value of the variable parameter is %,= 4.00. At T = 1.00 


seconds the parameter is changed to 


x(t) =4.0+0.1¢t 
as shown in figure (7b). The amount of the parameter change is identi- 
fied in the same manner as was discussed in example (1). The sampling 
time used is At = 0.01 sec. A step reference input of magnitude ten is 
used, Table (III) gives the results of the computer simulation of this 
example and the value of the parameters which are determined by the identi- 
fication process are plotted as crosses on figure (7b). The accuracy of 
the identification process is given by the percent error in the identifi- 


cation which was defined in example (1). 


Table (IIT) 


Time actual identified % error in 
X(t) HK, (t) identification 

1.01 4.10100 4.10089 0.00465 

02 4.10200 4.10178 0.00532 

1.03 4.10300 4.10281 0.004625 

1.04 4.10400 4.10390 0.002254 

LAOS 4.10500 4.10508 0.00209 

e206 4.10600 4.10636 0.00800 


Figure (7b) shows that the parameter values which are determined 


by the identification process follow the actual parameter values very 
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closely for the first five or six samples. After this the accuracy of 
the identification process begins to fall off. This is in part due to 
the build up of truncation and round-off errors in the computer simulation. 
The accuracy of the identification process is diminished as the error be- 
tween the output of the plant and the output of the model begins to in- 
crease. However, it should be noted that when the identification process 
is incorporated into the adaptive control system, the modification process 
will be correcting the system after the first few samples. Thus, extreme 
accuracy in the identification process is only required for the first few 
sampling intervals after the parameter change occurs and before modifica- 
tion is affected. 

The mathematical expression which is used to determine the 
amount that the parameter varies, equation (22), assumes that; 


daa] —, 


dt 


This assumption is not valid in this example, thus, some error is intro- 
duced into the identification process by assuming that the parameter does 


not change with time. 


Example (4) 

In this example, the second order plant of example (3) under- 
goes a sinusoidal parameter change at time T = 1.0 seconds. Prior to the 
parameter change A(t) = 4.0 and after the parameter is changed 


a(t)=> 4.0 + Ol Sin CWt) 


The results of this example are shown in Tables (IVa), (IVb), and (IVc). 
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Table (IVa) 


w = 1.0 radians/second 


Time actual identified Loeeror in 
A(t) Ar(t) identification 
1,01 4.08481 4.084476 0.005066 
O02 4.08526 08499 0.005299 
r.03 4.08571 08554 0.004715 
1.04 4.08616 08612 0.003197 
205 4.08677 08672 0.000560 
1.06 4.08721 .08809 0.003299 
07 4.08788 .08809 0.008982 
1.08 4.08829 . 08887 0.016469 
1.09 4.088701 4.08973 0.026310 
10 4.08910 4.09072 0.039111 
Table (IVb) 
w = 5.0 radians/second 
Time actual identified % error in 
X(t) Kr (t) identification 

1.01 3.90400 90403 0.0020275 
1.02 3.90545 90556 0.0020999 
1.03 3290725 90755 0.0034413 
1.04 3.90937 90997 0.0138803 
he0> 3-91170 .91286 0.0308411 
00 3291428 .91631 0.0563080 
107 329709 92041 0.0927920 
1.08 3.92014 P9252] 0.1433800 
1.09 3.923396 93104 0.2120900 
1.10 3.920687 . 93793 0.3042000 


Table (IVc) 


w = 10.0 radians/second 


Time actual identified % error in 
A (t) A, (t) identification 
1.01 3.9450 3.94555 0.0011119 
1,02 34 9357 3.93663 0.0218220 
L032 3.9208 3.92790 0.0537020 
1.04 3.9234 3.91943 0.0907230 
1.05 Oo Lorn 3.9183 0.1504080 
1.06 3.9134 3. 90367 0.2136500 


These results are plotted on figures (8a), (8b), and (8c) respectively. 
The solid curves represent the actual parameter values and the crosses 
represent the parameter values determined by the identification process. 

This example has shown that the identification methods intro- 
duced in this paper can follow a sinusoidally varying parameter change 
with a high degree of accuracy. The accuracy of the identification pro- 
cess is better for a slowly varying sinusoid than it is for a sinusoid 
with a higher frequency. 

Examples (3) and (4) have explicitly shown that the parameter 
identification process can follow a time varying parameter change with a 
high degree of precision. This high degree of accuracy generally holds 
for the first five or six sampling intervals unless the parameter varia- 
tion is rapid. It should be remembered that the modification process 
requires very accurate information from the identification only in the 
first few sampling intervals. After this time, some modification has 
been made to the system so that the identification process must begin all 
over. Identification in an adaptive control system is discontinuous, 


whereas the identification employed in these examples was continuous. 


40 


A(t) = 4.0 fort < T 


tee Olt On lest (Ot ptor te... I 
x - identified parameter values 
parameter 
4.090 value 





k actual 


7-084 


4,083 - a tt time 
Lol 62 103 hoy os 7/06 1.07 10@ bop 1,tO (sec) 


Fig. (8a) 


4) 


Kl) = 4.0 for t<¢ T 
A(O = 4.0 + 0.1 sin (5.0t) fort > T 









parameter 
value x 

3.928 
3,126 
3.924 + 

| KW _s actual 

! 
3.720+ x 


3.918 


3.916 


identified parameter 
values 


EFUB aneenen | sceiahiieeietimaetenenns tem 2 ree: 


3.914 4 


3.412 


aaiematinis Stetel 


if 


3.910 


3.908 


_ 
ae’ 
Oo 
Ce 


3.902 
time 


sec 


Lol hog §o3 oY hog 106 1.07 1.08 ogo hio afl 


Fig. (8b) 


42 


dé) = 4.0 fort < T 
Alf) = 4.0 + 0.1 sin (10.0t) for t > T 
x - identified parameter values 
parameter 
value 
3.95 
3644 
x 
93 
3.92 , ye actual 
3.91 x 
x ; 
3.90 time 
(sec) 
Ol 102 03 MOY 05 106 oT /08 109 tO 
Fig. (8c) 


43 


Example (5) First order plant, two variable parameters 
This example serves to show the effectiveness of the parameter 
identification process on the two variable parameter plant of figure (9). 


The state equations for a digital computer simulation are; 
X(t) = —(GotAo) Xm(t) + E(é Ge 
Xp (t) = -(GtA) Xp(t) + E(t)G 
V(t) 2 -(GetAy) V(t) —AXm (4) 


Va(t) = ~(GotAe) Vy lt) — GoXm(t) + Go Ele 


where A, = 0.5, G, = 2.0, At = 0.01 seconds and the reference input 
is a step input of magnitude ten. At time T = 1.50 seconds, A was 
changed from 0.50 to 0.51. or a 1.96% parameter change, and G was changed 


from 2.00 to 2.05, or a 2.5% parameter change. From equations (26) and 


(27) the following results: 





4A MV(TEAEYHAV, (7) Vg (T#At)-VQ(T) e(T+at) - e(T) 

rg V (Te2ae)-V,(THOt) Vv, (THZOL)-~Y(THAt)} | C(T42ae) - © (THO) 
Civ "E 

Ne = AS CGN) AG FG, C(a,!) 


These equations form the mathematical expressions used in the identifica- 


tion process. 
The results of this example are shown in table (V). The ac- 


curey of the identification is given by the percent error in the identi- 


fication process which was defined previously. 
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Table (V) 


Time identified % error in identi fied % error in 
A identification G identification 
of A of G 
1252 0.51200 0.39218 2.0572 0.35 h23 
1.54 0.50301 0.60130 2.0097 0.48609 
1.56 0.50301 0.60130 2.0098 0.48938 
1.58 0.49767 0.66536 0.9904 0.48960 
1.60 0.49757 0.68635 1.9899 0.50435 


It should be noted that the identification for a two variable 
parameter plant occurs on every other sampling interval. This is because 
two samples are required to perform the identification as there are two 
simultaneous equations which must be solved in order to perform the 
identification. 

This example has shown that the identification of two variable 
parameters is not as accurate as that for only one variable parameter. 
Much of the error in the two variable parameter case arises from the 
matrix techniques which are used in the computer simulation. However, 
the accuracy of the identification is sufficient for the adaptive control 
systems described in this paper. In the adaptive control system, modifi- 
cation takes place as soon as the parameter is identified, so that only 


the first identified values are of importance. 
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6. Adaptive Control Systems 

The previous sections have shown that the adaptive control system 
must have a plant and sensitivity model. The adaptive system must have 
an identifier which receives information from the error signal and the 
sensitivity model. The adaptive system must also have a means of trig- 
gering the sensitivity model when the error signal ceases to be zero. 
The amount of success of the adaptive control system to minimize the 
error is in direct proportion to the accuracy of the identification pro- 
cess. The accuracy of the identification depends upon the sampling inter- 
val which is used and upon the accuracy of the computations used in the 
digital simulation of the models and the identifier. 

In this paper, two adaptive techniques are proposed. Both of these 
techniques are identical in the methods used to decide whether or not a 
parameter has changed and the methods used in the identification of the 
parameter change. The difference in these two techniques lies in the 


method used to modify the system to compensate for the parameter change. 


6.1 Adaptive Technique One. 

The adaptive control system which employs modification technique one 
is shown in figure (10). In this method of modification, the adaptive 
controller uses the information which it receives from the identifier to 
physically change one of the parameters of the plant. One way to ac- 
complish this is to readjust the parameter which has varied. The amount 
of readjustment is determined by the identification process. The identi- 
fication and modification processes continue until the error is reduced 
to zero or a suitable value. It should be noted that the plant and the 
model both generate signals continuously while modification and identifi- 


cation are in process. 
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If the plant which is to be employed in the adaptive scheme has one 
parameter which is variable and a different parameter which is adjustable, 
then parameter plane theory may be used in the modification process. 

When the plant consists of a dominant pair of complex poles which must be 
maintained invarient as a parameter of the plant varies, and the character- 
istic equation of the plant exhibits singular lines on the parameter plane, 
then adjustment may be made based on the singular line for the dominant 
complex poles in question. When the plant possesses an invarient real 

root which is dominant, then adjustment may be made based on a constant 
sigma line of the parameter plane. Singular lines and constant sigma 

lines plot as straight lines on the parameter plane. Thus, they provide 


a linear straight line relationship for parameter adjustment. 


Example (1) First order plant, one variable parameter. 

This example serves to itftrecrare the use of adaptive technique one 
on the low pass filter of example (1) of the previous section. The adap- 
tive control system was simulated on an IBM-360 digital computer using 
the Fortran flow graph shown in figure (11). 

For this example, the variable parameter & undergoes a step change 
at time T = 1.5 seconds from %= 0.2 to & = 0.19. The amount of the 


parameter change which is determined by the identification process is 


given by; 
Ads = Ke CCi At le eCn) 
V(T+4t) -— V(T) 
where At = 0.10 seconds. The modification process, which is accomplish- 


ed by the adaptive controller, readjusts the parameter in the plant by the 
amount Aa, determined by identification. 
Figures (12a), (12b), and (12c) show the error between the plant out- 


put and the model output for a step, ramp, and sinusoidal reference input 
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respectively. The error is shown for the adapted and the unadapted 
systems. In the unadapted system, the parameter changes at the time given 
above, but, modification of the system is not accomplished. Examination 
of these figures shows that the adaptive scheme produces a marked improve- 
ment on the performance of the plant when one of the plant parameters 


undergoes a change. 


Example (2) First order plant, two variable parameters 

For this example, the system shown in figure (9) is adapted by techni- 
que one. At time T= 1.5 seconds, the parameter A was changed from 
0.5 to 0.51 and the parameter G was changed from 2.00 to 2.05. Both of 
the parameters were changed simultaneously. As in example (1), both of 
the parameters were readjusted by the amount determined by the identifi- 
cation process. 

The results of this example are shown in figure (13). The error 
between the plant and the model output for the adapted and the unadapted 
systems are shown. As in the previous example, the adaptive scheme pro- 
duces a significant improvement in the plant. That is, the error is re- 


duced to zero very rapidly and the plant follows the model very accurately. 


Example (3) Third order plant, one variable parameter 

The third order plant of figure (14a) has one parameter which is 
variable, o& , and a different parameter, CG which is adjustable. The 
design specifications on this system require the plant to maintain a 
dominant pair of complex roots with a ¢ of 0.5 and Wo of 4.0. Due to 
changes in the environmental conditions, the parameter will vary about 
its nominal value of %, = 5.10. As the location of the dominant roots 
must be maintained invarient, the system will be used in a self-adaptive 
mode with variations in & being compensated for by adjusting the value 


of GC 
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Bodie, [11], has shown the criteria for determining whether or not 
a plant characteristic equation exhibits singular lines on the parameter 
plane. A singular line plots as a straight line and represents a constant 
t constant W, line. That is, there are an infinite number of & , 
6 pairs which lie on the singular line and will give exactly the same 
pair of dominant complex roots. 


The plant of figure (14a) possesses a singular line for cs = 0.50 and 


w= 4.00. The equation of the singular line is given by; 
3= 1.156 + 0.935 & 


At time T = 0.1 seconds, the parameter & undergoes a change from 5.10 
to 4.50, or a 12% parameter change, which is identified by the identifi- 
cation process as 4.50043. The adaptive controller then uses the value 
of co determined by the identification in the equation of the singular 
line to determine the value that 6 must be adjusted to in order to 
maintain the dominant complex roots desired. 

Figure (14b) shows the error between the plant and the model outputs 
for the adapted and the unadapted systems. In the unadapted system, para- 
meter ce underwent a change, but 6 was not adjusted to compensate for 
the variation in & . Singular line theory provides a relatively simple 
means of performing the modification process. Of course not all systems 
possess singular lines, and the methods used to determine if singular 


lines exist are rather laborious. 


Example (4) Third order system, one variable parameter 

Many control system designs require that a real root be the dominant 
root. The plant of figure (15a) is required to have a dominant, invarient, 
real root at sigma equals 2.0 irregardless of how any of the other roots 
may vary. In this plant, MQ , will vary with changing environmental 
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conditions, and @ is an adjustable parameter. The equation of the 


constant sigma equal 2.0 line on the parameter plane is given by; 
re 0.40 + 0.800% 


At time T = 0.1 seconds, parameter &% undergoes a change from its 
nominal value of A, =4.0 to OX = 3.5. The identification process 
determined the new value of O& to be 3.49597. Using the new value of 

A determined by identification, the adaptive controller finds the 
value of € which is necessary to compensate for the change in & 
This new value of e is determined from the equation of the constant 
sigma line given above. 

Figure (15b) shows the error between the output of the model and the 
output of the plant for the adapted and the unadapted systems. The use 
of constant sigma lines in the modification process has proved to be very 
effective in reducing the error caused by a parameter change in the plant. 
This method is only effective when the system response has a zero steady 
state error as a change in the parameters will change the steady state 
error in other systems and the plant will be unable to follow the model. 

In general, there is a great improvement in the performance of the 
plant when adaptive technique one is implemented for the modification 
process. In all of the previous examples the error between the output of 
the plant and the output of the model was decreased to almost zero in a 
very short period of time. It should be noted that the implementation of 
this adaptive technique requires at least one parameter which can be phys- 
ically adjusted. If the adjustable parameter is not the parameter which 
is subject to variation, then modification must be made based upon either 
a singular line or a constant sigma line. If the plant does not possess 
singular lines on the parameter plane, and a pair of dominant complex roots 


must be maintained invarient, consideration should be given to re-designing 
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the plant so that it does possess singular lines, or the use of the 


technique discussed in the next section. 


6.2 Adaptive Technique Two 

In adaptive technique two, shown in figure (16), the adaptive con- 
troller uses the information provided by the identification process to 
generate an optimum control, u*(t), which when put into the plant, will 
compensate for the parameter variation. This optimum control is for the 


is the time at which the plant 


~ 


time interval T € t <€ tes where ty 
operation ends or the time at which a second parameter change occurs. 

Note that only one control history need be generated if only one parameter 
change occurs. 

The optimum control can be generated by many means. As the overall 
controller, or the self-adaptive portion of the system, is digital in 
nature, a numerical technique such as the method of steepest descent can 
be implemented very easily. In the use of a numerical technique, the 


adaptive controller uses the information from the identification process 


to generate an error history and then minimize the performance index 
tr 3 
(33) T=3 f e(t) dt 
T 


with respect to u(t) to obtain the optimum control. The optimum control 
which is generated is in open loop form, thus the exact plant state values 
do not need to be determined. 

The control, u(t), for adaptive technique two can also be found by 
considering the transfer functions of the plant and the model in their 
Laplace form. Consider a low pass filter with one variable parameter. 
Let: 

G(s) = Transfer function of the plant 


G'(s) = Transfer function of the model 
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R(s) = Input to the model 


U(s) = Input to the plant 
oo = Output of the plant 
x 6S) = Output of the model 


G(s) = xs) / U(s) and G'(s) = x Cs) / R(s) 


The error is given by; 


(34) e(s) = SD - X (s) 
Now: ee = U(s)G(s) 
x 6s) = R(s)G'(s) 


therefore, 


(35) e(s) = U(s)G(s) - R(s)G'‘(s) 


From equation (5), the error can be written as; 


e(s\= = ie 


where V(s) is the sensitivity of the output with respect to parameter 
Therefore, equation (34) can be written as; 
(36) 8A vis) = Us) G(s) — Ris) G(s) 

° 


Equation (36) is solved for U(s) to give; 


ns G(s) 4 _Oa _Vis) 
(37) Us) = R(s) a8) xX Gis 


From figure (17) it is apparent that, 





a x = Ko 
Cis) = ese VCS) “(s4a,)" 
(38) z 
G (S) = “<a Ks) = R 
Substituting equation (38) into equation (37) yields; 
(39) RX (Ss+x) Ac (S+a) 
U(s) = (Se) Coe ee eee 
( e S(S+t&o) | A (S+«,)* 
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which yields; 
Xt 
ta o% 
Equation (40) can be simulated and solved by the adaptive controller 
using the values of the parameters determined by the identification pro- 
cess. Equation (40) represents the exact time relationship for the con- 


trol to apply to the plant at time t = T. 


Example (1) First order plant, one variable parameter 

This example serves to illustrate the use of adaptive technique two 
on the low pass filter of the previous example. The flow graph for the 
computer simulation of this example is shown in figure (18). 

For this example, the variable parameter was changed from 0.2 to 
0.19 at time T = 1.5 sec. Parameter identification is accomplished as in 
Section 5. 

The identified value of the parameter is used in the numerical method 
of steepest descent which generates an optimum control, u*(t), for the 
time interval T $ t ¢€ te. This optimum control history is then applied 
to the plant. The steepest descent method of generating an optimum con- 
trol is described in Appendix (A). 

The results of this example are shown in figures (19a), (19b), and 
(19c), for step, ramp, and sinusoidal inputs. 

One of the inaccuracies introduced into technique two arises from 
the method of generating the optimum control. To improve the accuracy 
of the optimum control, the stopping criteria for the steepest descent 
method may be made smaller, thus increasing the number of iterations re- 
quired to achieve optimality. Theoretically it would take an infinite 


number of iterations to reach an exact optimum. 


Technique two is less accurate than technique one. However, the 
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magnitude of the error has, in general, been decreased by at least a 
factor of ten. An overall improvement in system performance is notice- 
able. 

Equation (40) gives the exact time relationship for the control to 
be applied in adaptive technique two for this example. Figure (20) shows 
the resulting error for a step input using equation (40) to generate the 
control rather than using the method of steepest descent. The identifica- 
tion process provides values for AQ and & 

Both the numerical method and the method of equation (40) show a 
marked improvement in the performance of the system. However, the numeri- 
cal method is more accurate in that the magnitude of the error is smaller 
and the error approaches zero more rapidly. 

The main disadvantage to the use of a numerical method is that it is 
time consuming. This is due to the fact that the numerical method is an 
iterative procedure. The exact time relationship for the control, when 
used in adaptive technique two, results in a shorter time required for the 
overall adaptive process. This is a large factor to consider in a real 


time problem. 
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r(t) = 10.0 for all time 


Fig. (20) 


70 


1% Conclusions. 

A model-referenced adaptive control system provides an excellent 
means of compensating for parameter variations caused by changing environ- 
mental conditions. This type of adaptive control system requires apriori 
knowledge of the nominal plant differential equations and will, in general, 
be implemented by a digital controller. However, it is possible to ac- 
complish the self-adaptive scheme with analog models. 

Sensitivity functions provide an excellent tool for the purpose of 
parameter identification. The parameter identification process is the 
most critical part of the adaptive scheme in that proper modification 
can not be accomplished with inaccurate parameter identification. All of 
the work presented in this paper assumed that the process of measuring 
the output of the plant was free of measurement noise. When noise is 
added to the output of the plant, parameter identification becomes a very 
difficult task. The problem of noise in the output, and the methods 
which are necessary to overcome the noise in the proposed identification 
process, are beyond the scope of this thesis. 

This paper has suggested three means by which the modification pro- 
cess may be accomplished. Each of these techniques has proven to be very 


effective. 
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oe Suggestions for Further Investigation. 
As a result of this study there are several areas where further 
research is recommended. 
(a) The effects of observation noise on the identification 
process. 
(b) Identification of several variables which change independent- 
Lye 
(c) Extension of parameter plane techniques for the compensa- 


tion of uncontrollable parameter variations. 


TZ 
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APPENDIX A 
Method of Steepest Descent 
The method of steepest descent is a numerical procedure for generat- 
ing an optimal control history by minimizing a given cost function with 
respect to the control. 


The cost function which is chosen, in this paper, to be minimized 


is. 
| *f é 
(A-1) J= +f [xp(e) Xm (4)] dt 
to 
where 25 ley = x(t) = e(t) 


The output of the plant is subject to the constraint 
Xp lt) =X Xe(t) + @ ult) 


The Hamiltonian for this cost function is given by, 
z 2 
(A-2) C= X pled + Xp (4) ~— AX X(t) + p (4) [x Xp (t) +@ ult)] 


where p(t) is the costate for the above constraint. 


The costate equations are given by, 


p(t) = 24 — 
(A-3) P 
p(t) = -2[Xp(t)—Xm(t)] — % p(t) 
The gradient of the Hamiltonian with respect to the control, u(t), is 
given by, 


(A-4) Yt = = = @ pit) 


The boundry conditions are given by, 


p(t,) = 0.0 
co - 2s 
(A-5) x ft) #3 
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The iterative procedure is begun by solving the state equations for 


the plant and for the model for the time interval 


pete fe 


O r 


using the initial control history 


u(t) = r(t) 
where 
u(t) = input to the plant 
r(t) = input to the model 


The model state equations are 


(A-6) Xo (4) = k Xn lt) t @’ cle) 


! / 
where o and € are known. 


The plant state equations are 
(7) Xp (t) = K Xp (4) + B ule) 


where CA _ and G are determined by the parameter identification pro- 
cess. 

The state trajectories for the plant and the model are then used 
to solve the costate equations. The costate trajectory is then used to 
determine the gradient of the Hamiltonian with respect to the control. 
If the initial control history, u(t), was the optimal control then 

Via =o 
and the iterative procedure is terminated. 
As it is difficult to make [UZHEO> 4 suitable stopping criteria 


must be chosen. The stopping criteria used in this paper is 
(A-8) Norm < 0.0001 


where 
715 


c 
a < 
(A-9) oe [ (YX) dt 
t, 
If the stopping criteria is not satisfied then the control is up- 


dated by, 
(A-10) KUleho=ulit)- Ww UX 


and the iterative procedure returns to the state equations. The steepest 
descent step size, GY , must be changed if the cost function is in- 
creasing from one iteration to the next, and must be constant if the cost 
function decreases from one iteration to the next. In this paper, WY , 
was set equal to one for the first iteration. At the end of each itera- 
tion, the cost function is evaluated. If the cost function is decreasing, 
“W is held constant, and if the cost function is greater than it was 
for the last iteration, then Ww is multiplied by one half. 

In order for adaptive technique two to be successful using this 
method, the stopping criteria must be satisfied. This could take many 


iterations and could be very time consuming. 
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